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Evolutionary computing (EC) is an exciting development in Computer Science. It amounts to building, applying 
and studying algorithms based on the Darwinian principles of natural selection. In this paper we briefly introduce 
the main concepts behind evolutionary computing. We present the main components all evolutionary algorithms 
(EA), sketch the differences between different types of EAs and survey application areas ranging from optimization, 
modeling and simulation to entertainment. 
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1. Introduction 

Surprisingly enough, the idea to apply Dar- 
winian principles to automated problem solving 
originates from the fifties, long before the break- 
through of computers jj) 4 . During the sixties 
three different implementations of this idea have 
been developed at three different places. In the 
USA Fogel introduced evolutionary programming 
|11I8| . while Holland called his method a genetic 
algorithm |13I12| . In Germany Rechenberg and 
Schwefel invented evolution strategies |15I16| . For 
about 15 years these areas developed separately; 
it is since the early nineties that they are envi- 
sioned as different representatives ("dialects") of 
one technology, called evolutionary computing. It 
was also in the early nineties that a fourth stream 
following the general ideas has emerged - genetic 
programming |14I2| . The contemporary terminol- 
ogy denotes the whole held by evolutionary com- 
puting and considers evolutionary programming, 
evolution strategies, genetic algorithms, and ge- 
netic programming as sub-areas. 

2. What is an evolutionary algorithm? 

The common underlying idea behind all these 
techniques is the same: given a population of 
individuals, the environmental pressure causes 
natural selection (survival of the fittest) and 



hereby the fitness of the population is growing. 
It is easy to see such a process as optimization. 
Given an objective function to be maximized we 
can randomly create a set of candidate solutions 
and use the objective function as an abstract 
fitness measure (the higher the better). Based 
on this fitness, some of the better candidates are 
chosen to seed the next generation by applying 
recombination and/or mutation. Recombina- 
tion is applied to two selected candidates, the 
so-called parents, and results one or two new 
candidates, the children. Mutation is applied to 
one candidate and results in one new candidate. 
Applying recombination and mutation leads to a 
set of new candidates, the offspring. Based on 
their fitness these offspring compete with the old 
candidates for a place in the next generation. 
This process can be iterated until a solution is 
found or a previously set time limit is reached. 
Let us note that many components of such an 
evolutionary process are stochastic. According to 
Darwin, the emergence of new species, adapted 
to their environment, is a consequence of the 
interaction between the survival of the fittest 
mechanism and undirected variations. Variation 
operators must be stochastic, the choice on which 
pieces of information will be exchanged during 
recombination, as well as the changes in a can- 
didate solution during mutation, are random. 
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On the other hand, selection operators can be 
either deterministic, or stochastic. In the latter 
case fitter individuals have a higher chance to 
be selected than less fit ones, but typically even 
the weak individuals have a chance to become 
a parent or to survive. The general scheme of 
an evolutionary algorithm can be given as follows. 

Initialize population with random 

individuals (candidate solutions) 
Evaluate (compute fitness of) all 
individuals 
WHILE not stop DO 

Select genitors from parent population 

Create offspring using 

variation operators on genitors 

Evaluate newborn offspring 

Replace some parents by some offspring 

OD 

Let us note that this scheme falls in the cat- 
egory of generate-and-test, also known as trial- 
and-error, algorithms. The fitness function rep- 
resents a heuristic estimation of solution quality 
and the search process is driven by the variation 
operators (recombination and mutation creating 
new candidate solutions) and the selection oper- 
ators. Evolutionary algorithms (EA) are distin- 
guished within in the family of generate-and-test 
methods by being population based, i.e. process 
a whole set of candidate solutions and by the use 
of recombination to mix information of two can- 
didate solutions. 

The aforementioned "dialects" of evolutionary 
computing follow the above general outlines and 
differ only in technical details. 

3. Critical issues 

There are some issues that one should keep in 
mind when designing and running an evolution- 
ary algorithm. These considerations concern all 
of the "dialects" , and will be discussed here in 
general, without a specific type of evolutionary 
algorithm in mind. 

One crucial issue when running an EA is to try 
to preserve the genetic diversity of the popula- 
tion as long as possible. Opposite to many other 



optimization methods, EAs use a whole popula- 
tion of individuals - and this is one of the rea- 
sons for their power. However, if that popula- 
tions starts to concentrate in a very narrow re- 
gion of the search space, all advantages of han- 
dling many different individuals vanish, while the 
burden of computing their fitnesses remains. This 
phenomenon is known as premature convergence. 
There are two main directions to prevent this: a 
priori ensuring creation of new material, for in- 
stance by using a high level of mutation (see sec- 
tion 14.3.3(1 ; or a posteriori manipulating the fit- 
nesses of all individuals to create a bias against 
being similar, or close to, existing candidates. 
A well-known technique is the so-called niching 
mechanism. 

Exploration and exploitation are two terms of- 
ten used in EC. Although crisp definitions are 
lacking there has been a lot of discussion about 
them. The dilemma within an optimization pro- 
cedure is whether to search around the best-so-far 
solutions (as their neighborhood hopefully con- 
tains even better points) or explore some totally 
different regions of the search space (as the best- 
so-far solutions might only be local optima). An 
EA must be set up in such a way that it solves this 
dilemma without a priori knowledge of the kind 
of landscape it will have to explore. The exploita- 
tion phase can sometimes be "delegated" to some 
local optimization procedure, whether called as 
a mutation operator, or systematically applied 
to all newborn individuals, moving them to the 
nearest local optimum. In the latter case, the 
resulting hybrid algorithm is called a memetic al- 
gorithm. 

In general, there are two driving forces behind 
an EA: selection and variation. The first one rep- 
resents a push toward quality and is reducing the 
genetic diversity of the population. The second 
one, implemented by recombination and mutation 
operators, represents a push toward novelty and 
is increasing genetic diversity. To have an EA 
work properly, an appropriate balance between 
these two forces has to be maintained. At the 
moment, however, there is not much theory sup- 
porting practical EA design. 
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4. Components of evolutionary algorithms 

4.1. Representation 

Solving a given problem with an EA starts with 
specifying a representation of the candidate solu- 
tions. Such candidate solutions are seen as pheno- 
types that can have very complex structures. Ap- 
plying variation operators directly to these struc- 
tures might not be possible, or easy. There- 
fore these phenotypes are represented by corre- 
sponding genotypes. The standard EC machin- 
ery consists of many off-the-shelf variation op- 
erators acting on a specific genotype space, for 
instance bit-strings, real-valued vectors, permu- 
tations of integers, or trees. Designing an EA 
thus often amounts to choosing one of the stan- 
dard representations with the corresponding vari- 
ation operators in mind. However, one strength 
of EAs is their ability to tackle any search space 
provided that initialization and variation opera- 
tors are available. Choosing a standard option is, 
therefore, not necessary. 

4.2. Fitness or evaluation function 

Fitness-based selection is the force that repre- 
sents the drive toward quality improvements in an 
EA. Designing the fitness function (or evaluation 
function) is therefore crucial. 

The first important feature about fitness com- 
putation is that it represents 99% of the total 
computational cost of evolution in most real- 
world problems. Second, the fitness function very 
often is the only information about the problem 
in the algorithm: Any available and usable knowl- 
edge about the problem domain should be used. 

4.3. Representation dependent 
4.3.1. Initialization 

The initial population is usually created by 
some random sampling of the search space, gen- 
erally performed as uniformly as possible. How- 
ever, in some cases, uniform sampling might not 
be well-defined, e.g. on parse-tree spaces, or on 
unbounded intervals for floating-point numbers. 

A common practice also is to inoculate some 
known good solutions into the initial population. 
But beware that no bias is better than a wrong 
bias! 



4.3.2. Crossover 

Crossover operators take two (or more) par- 
ents and generate offspring by exchange of in- 
formation between the parents. The underlying 
idea to explain crossover performance is that the 
good fitness of the parents is somehow due to pre- 
cise parts of their genetic material (termed build- 
ing blocks), and the recombining those building 
blocks will result in an increase in fitness. 

Nevertheless, there are numerous other ways 
to perform crossover. For instance, crossing over 
two vectors of floating-points values can be done 
by linear combination (with uniformly drawn 
weights) of the parents values. The idea is that 
information pertaining to the problem at hand 
should be somehow exchanged. 

Note that the effect of crossover varies from ex- 
ploration when the population is highly diversi- 
fied to exploitation when it starts to collapse into 
a small region of the search space. 

4.3.3. Mutation 

Mutation operators are stochastic transforma- 
tions of an individual. The usual compromise be- 
tween exploration and exploitation must be main- 
tained: large mutations are necessary from theo- 
retical reasons (it ensures the ergodicity of the un- 
derlying stochastic process), that translate prac- 
tically (it is the only way to reintroduce genetic 
diversity in the end of evolution); but of course 
too much too large mutation transform the algo- 
rithm into a random walk - so most mutations 
should generate offspring close to their parents. 
There is no standard general mutation, but gen- 
eral trends are to modify the value of a component 
of the genotype with a small probability (e.g. flip 
one bit of a bitstring, or, in case of real-valued 
components, add zero-mean Gaussian noise with 
carefully tuned standard deviation). 

4.3.4. The historical debate 

There has long been a strong debate about the 
usefulness of crossover. The GA community con- 
siders crossover to be the essential variation oper- 
ator |13ll2j , while mutation is only a background 
necessity. On the other hand, the historical ES 
|15I16| and EP ^T] researchers did not use any 
crossover at all, and even claimed later that it 
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could be harmful |1(J) . 

The general agreement nowadays is that the an- 
swer is problem-dependent: If there exists a "se- 
mantically meaningful" crossover for the problem 
at hand, it is probably a good idea to use it. But 
otherwise mutation alone might be sufficient to 
find good solutions - and the resulting algorithm 
can still be called an Evolutionary Algorithm. 

4.4. Representation-independent 
4.4.1. Artificial Darwinism 

Darwin's theory states that the fittest individu- 
als reproduce and survive. The evolution engine, 
i.e. the two steps of selection (of some parents 
to become genitors) and replacement (of some 
parents by newborn offspring) are the artificial 
implementations of these two selective processes. 
They differ in an essential way: during selection 
step, the same parent can be selected many times; 
during replacement step, each individual (among 
parents and offspring) either is selected, or disap- 
pears for ever. 

Proportional selection (aka roulette-wheel) has 
long been the most popular selection operator: 
each parent has a probability to be selected that 
is proportional to its fitness. However, the diffi- 
culty is to scale the fitness to tune the selection 
pressure: even the greatest care will not prevent 
some super-individual to take over the population 
in a very short time. Hence the most widely used 
today is tournament selection: to select one indi- 
vidual, T individuals are uniformly chosen, and 
the best of these T is returned. Of course, both 
roulette-wheel and tournament repeatedly act on 
the same current population, to allow for multiple 
selection of the very best individuals. 

There are two broad categories of replacement 
methods: either the parents and the offspring 
"fight" for survival, or only some offspring are 
allowed to survive. Denoting by fi (resp. A) the 
number of parents (resp. offspring) as in ES his- 
tory (section 15. 2|) , the former strategy is called 
(fx + A) and the latter (/z, A). When fi = A, the 
comma strategy is also known as generational re- 
placement: all offspring simply replace all par- 
ents. When A = 1, the (plus!) strategy is then 
termed steady-state and amounts to choosing one 
parent to be replaced. 



An important point about the evolution engine 
is the monotonicity of the best fitness along evo- 
lution: for instance, ES plus strategies are elitist, 
i.e. ensure that the best fitness can only increase 
from one generation to another, while the comma 
strategies are not elitist - though elitism can be 
a posteriori added by retaining the best parent 
when a decrease of fitness is foreseen. 

4.4.2. Termination criterion 

There has been very few theoretical studies 
about when to stop an Evolutionary Algorithm. 
The usual stopping criterion is a fixed amount of 
computing time (or, almost equivalently, of fit- 
ness computations). A slightly more subtle cri- 
terion is to stop when a user-defined amount of 
time has passed without improvement of the best 
fitness in the population. 

4.5. Setting the parameters 

EAs typically have a large number of param- 
eters (e.g. population size, frequency of recom- 
bination, mutation step-size, selective pressure, 
. . . ) . The main problem in this respect is that 
even the individual effect of one parameter is of- 
ten unpredictable, let alone the combined influ- 
ence of all parameters. Most authors rely on in- 
tensive trials (dozens of independent runs for each 
possible parameter setting) to calibrate their al- 
gorithms - an option that is clearly very time 
consuming. Another possibility is to use long- 
existing statistical techniques like ANOVA. A 
specific evolutionary trend is to let the EA cali- 
brate itself to a given problem, while solving that 
problem (see section l5~2t . 

4.6. Result analysis 

As with any randomized algorithm, the results 
of a single run of an EA are meaningless. A typ- 
ical experimental analysis will run say over more 
than 15 independent runs (everything equal ex- 
cept the initial population), and present averages, 
standard deviations, and T-test in case of com- 
parative experiments. 

However, one should distinguish design prob- 
lems, where the goal is to find at least one very 
good solution once, from day-to-day optimization 
(e.g. control, scheduling,...), where the goal is 
to consistently find a good solution for different 
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inputs. In the design context, a high standard 
deviation is desirable provided the average result 
is not too bad. In the optimization context, a 
good average and a small standard deviation are 
mandatory. 

5. Historical dialects 

As already quoted, EC arose from independent 
sources. Of course, each dialect exhibits a large 
variety in itself; the short descriptions here are 
necessarily restricted to one or two main variants. 

5.1. Genetic Algorithms 

The standard GA |18I12| can be seen as the 
combination of bit-string representation, with 
bit-exchange crossover (applied with given prob- 
ability p c ) and bit-flip mutation (applied to every 
bit with probability p m ), roulette- wheel selection 
plus generational replacement (though steady- 
state replacement can also be used). 

Note that other versions of EAs using the same 
evolution engine with different genotypes (and 
hence variation operators) are often called GA. 

5.2. Evolution Strategies 

Evolution strategies (ES) [15116] are typically 
applied to real-valued parameter optimization 
problems (historically discretized). ES apply to 
real-valued vectors using Gaussian mutation, no 
selection and (/z + replacement strategies. 
Crossover (historically absent) is performed ei- 
ther by exchanging components, or by doing a 
linear recombination on some components. 

The characteristic feature of ES lies in the self- 
adaptation of the standard deviation of the Gaus- 
sian distribution used in the mutation p^. The 
basic idea is to add these parameters to the geno- 
types, and have them undergo evolution them- 
selves. 

5.3. Evolutionary Programming 

Traditional EP JT] was concerned with evolv- 
ing finite state automata for machine learning 
tasks. Representation and operators were special- 
ized for this application area. Each parent gave 
birth by mutation only to one offspring, and a 
plus replacement strategy was used to remove half 
of the individuals. Contemporary EP, however, 



[B] has evolved to using any representation and 
different evolution engines, and nowadays differs 
from ES by using a stochastic form of the plus re- 
placement strategy, and by never using crossover 
(EP also uses self-adaptation of Gaussian muta- 
tion in the case of real- valued genotypes). 

5.4. Genetic Programming 

The youngest brother of the family |14I2| has 
a specific application area in machine learning 
and modeling tasks. A natural representation is 
that of parse-trees of formal logical expressions 
describing a model or procedure. Crossover and 
mutation operators are adapted so that they work 
on trees (with varying sizes) . Evolution engine is 
"inherited" from GAs (GP has long been seen as 
GA with tree representation). On the other hand, 
syntactic expressions - for instance LISP - can be 
viewed as programs, which makes GP the branch 
concerned with automatic evolution of programs. 

6. Application areas 

Although it is often stressed that an evolution- 
ary algorithm is not an optimizer in the strict 
sense optimization problems form the most 
important application area of EAs. Within this 
field further distinctions can be made, combina- 
torial optimization, continuous parameter opti- 
mization, or mixed discrete-continuous optimiza- 
tion. 

In the framework of combinatorial opti- 
mization, it is now recognized that EC alone is 
not competitive [HJ compared to classical Oper- 
ational Research heuristics. However, hybridiza- 
tion of EC with those specialized OR heuristics 
gave tremendous results, on benchmark problems 
(e.g. best-to-date results on some difficult graph 
coloring, quadratic assignment, or constraint sat- 
isfaction instances) as well as on many real- world 
problems (e.g. time-tabling in universities, crew 
scheduling in big companies, multiple tours with 
time- windows in distribution applications, . . .). 
It is worth mentioning here that combinatorial 
problems is today the most profitable application 
domain for EC. 

When it comes to continuous parametric 
optimization, the mistake to avoid is to try to 
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compete with highly performing numerical meth- 
ods. However, in many cases such methods do 
not apply (lack of regularity) or fail (high multi- 
modularity). In such contexts, EC has been suc- 
cessfully used for control, electromagnetism, fluid 
mechanics, structural analysis, . . . 

The flexibility of EC allows one to handle rep- 
resentations (section 14.1(1 that are out of reach 
of any other method. This is the case for mixed 
search spaces (with both discrete and continuous 
variables), and even more for variable length 
representations (e.g. parse trees of Genetic 
Programming, see section l574"j) . And this opens 
up the possibility for huge improvements in ar- 
eas such as Machine Learning (e.g. by evolving 
sets of rules, cellular automata rules, . . . ), model- 
ing (in the general framework of function identi- 
fication), design and art 0], where restricting the 
representation of the solutions to a fixed set of 
parameters definitely bias the search toward poo 
regions in terms of diversity. 

Finally, let us stress that one domain where 
Evolutionary Algorithms encounter an increasing 
attention is that of multi-objective optimiza- 
tion: specific selection methods [3] allow one to 
spread the population of an EA over the Pareto 
front of a multi-objective problem (the set of the 
best compromises between the objectives), requir- 
ing only a fraction of computing time more than 
the optimization of a single objective. 

7. Concluding remarks 

Natural evolution can be considered as a pow- 
erful problem solver achieving Homo Sapiens from 
chaos in only a couple of billion years. Computer- 
based evolutionary processes can also be used as 
efficient problem solvers for optimization, con- 
straint handling, machine learning and modeling 
tasks. Furthermore, many real-world phenomena 
from the study of life, economy, and society can 
be investigated by simulations based on evolving 
systems. Last but not least, evolutionary art and 
design form an emerging field of applications of 
the Darwinian ideas. We expect that computer 
applications based on evolutionary principles will 
gain popularity in the coming years in science, 
business, and entertainment. 
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